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Abstract 

The success of civilization is determined by the excellent education system and excellent education program, it is 
believed that the aims of producing outstanding and dedicated students are determined by the quality of education 
program. Students chose the education program based on many criteria, like job guarantee, reputation of the 
university, duration of the program etc. For the present research perception of stakeholders towards the effectiveness 
of diploma program, Majmaah University was selected. Questionnaire was distributed among the stakeholders of 
diploma program which include teachers, faculty members, members of the university’s chancellery, employers, 
funding body etc. To find out their perception towards the effectiveness of diploma program, different statistical 
tools were used to complete the present research. In the findings it has been found that there is a positive perception 
of stakeholders towards the effectiveness of diploma program. 
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1. Introduction 

To find the perception of stakeholders towards the effectiveness of diploma program, there are many universities in 
Saudi Arabia. For this research Majmaah University is chosen. It is considered one of the most recent universities in 
Saudi Arabia. This university and the universities like this were established to provide students of different regions 
with different academic skills, satisfy their scientific aspirations and to increase their awareness of their academic 
responsibilities, and encourage them to exert more efforts in solving the academic and personal problems that hinder 
their abilities from achieving optimum educational goal. Students are also initiated and encouraged to interact with 
the socio-cultural demands of the university life. 

In the same context of encouraging the establishment of new universities there has been an expansion in the 
provision of specialized diploma programs in the Saudi universities in general and the Majmaah university in 
particular. This comes as a continuation for the performance of the University mission to serve the people of Saudi 
society, who wish to achieve their ambitions and to continue their studies, the university carries out educational 
programs (Adult Education) in the province of Hafr Albatin, in cooperation between the Deanship of Community 
Service and Continuing Education and the Institute of Prince Salman for Studies and Advisory Services in the 
University. These programs are: Diploma in General Education (high), a Diploma in Guidance and Counseling 
Students (high). Diploma in Learning Resource Centers (high), Special Education Diploma, a diploma of 
Measurement and Evaluation (high). Attorneys' Diploma, Bachelor of Accounting and a Diploma of Technology 
Networks. The Majmaah University also launched the training program for the health diploma holders at the 
university in 2013, Computer Science Diploma (Networks Technology) in 2011. In addition, the university conducts 
seven educational programs (education parallel) in the city of Riyadh via the Deanship of Community Service and 
Continuing Education and the Institute of Prince Salman for studies and advisory services in 2012 (Majmaah, 2012) 

1.1 Terms of the Study: Evaluation 

The evaluation is considered one of an important part of effective teaching. As the title suggests the recent study is a 
measurement and evaluation of the effectiveness of diploma-level training in eight different academic fields in 
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Majmaah University. To begin, it is important to shed light on the major terms of the study. It is remarkable that 
evaluation is not equivalent to research, although it employs research techniques as a means of generating the 
necessary information, and uses similar criteria for the reliability and validity to judge the quality of the evidence. Also, 
evaluation tends to be broader than research, as it usually requires information about a range of situations, products and 
processes. However, the main difference between evaluation and research is that evaluation involves making 
judgments about the value of what is being evaluated (Manchester, 2013). 

However, evaluation can be formalised to an extent that it becomes research. Indeed, the focus of this project, where 
we are seeking explicit evaluation plans, is close to research. The problem with the label 'research' is that a great deal of 
evaluation research is flawed. Reeves (1993) list several of these flaws: 

• vague specification of primary independent variables; 

• lack of linkage to robust theory; 

• small sample size; 

• inadequate literature review; 

• inadequate treatment time (conclusions are sometimes made after students use materials for minutes); 

• obscure statistical analysis; 

• measurement flaws (precise measurement of easy-to-measure variables; more complex variables, which 
might be the crucial ones, are ignored); 

• inconsequential outcome measures (Philips, 2000) 

There are two common purposes in educational evaluation which are, at times, in conflict with one another. 
Educational institutions usually require evaluation data to demonstrate effectiveness to funders and other 
stakeholders, and to provide a measure of performance for marketing purposes. Educational evaluation is also a 
professional activity that individual educators need to undertake if they intend to continuously review and enhance 
the learning they are endeavoring to facilitate (World News, 2012). There are three main Standards for educational 
evaluation we should bear in mind when conducting the process of evaluation. The Joint Committee on Standards for 
Educational Evaluation (An American/Canadian based Standards Developer Organization (SDO) that represents a 
coalition of major professional associations formed in 1975 to help improve the quality of standardized evaluation) 
published three sets of standards for educational evaluations. The Personnel Evaluation Standards was published in 
1988, The Program Evaluation Standards (2nd edition) was published in 1994, and The Student Evaluations 
Standards was published in 2003. 


2. Review of Literature 

There is a good number of researches which favors the continuous use of professional development activities to 
improve academic programs on both levels of schools and universities. However, there is little evidence from 
research that indicates a connection within a development of profession models and the learning of students. One 
contributing factor is a lack of reliable data. This shortage of reliable data could be the result of a failure of school 
leaders to implement a continuous method of evaluating the utilization of strategies presented at staff development 
activities by the teaching staff (Guskey, 2000). It is indicated that in order to provide high quality professional 
development, school districts must fund, plan, implement, and evaluate activities that enhance teacher instruction and 
improve student achievement. Furthermore, Killion (2002) suggested that evaluation is perhaps the most critical 
component of effective professional development. She stated that evaluation should be comprehensive and ongoing. 
In addition to the formal evaluation at the end of a professional development activity, school districts should also 
conduct evaluations during the planning and implementation stages. To build a strong evaluation component, Guskey 
(2000) suggested that beginning with clear purposes and goals for professional development would make it easier for 
school district leaders to determine what types of data they would need for evaluation. 

Berends and others (2002) believe that the level of program implementation should affect expected student academic 
outcomes. Empirical evidence has supported this assumption by demonstrating both successful reforms and 
unsuccessful attempts where the level of implementation fidelity correlated with the outcome (Berends et ah, 2002; 
Berman & McLaughlin, 1976). In addition, Guskey (2002) suggested that an ongoing, systematic evaluation plan is 
perhaps the most critical component of planning and sustaining an effective professional development system. He 
reported that many schools and school systems were not examining how well professional development was working 
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because there was not an effective evaluation system in place. He suggested that one reason for this omission was 
that many administrators considered proper evaluation too costly to undertake. Borman and others (2005) argues that 
since the passage of the No Child Left Behind Act (NCLB) in 2001, schools at both the primary and secondary levels 
have turned to a variety of school reform models in an effort to raise the academic achievement of their students. As 
a result of the widespread need for successful reforms, national policy makers and local administrators look for 
reform programs that can be applied in multiple contexts and deliver measureable outcomes for stakeholders with a 
diversity of goals (Borman and others, 2008). On the importance of evaluation of programs Guskey and Sparks 
(1991) suggested that evaluation results provide valuable tools for monitoring and improving policies and procedures. 
To link professional development to improved teacher efficacy and indirectly to improved student achievement, 
school districts need to implement a carefully planned and executed evaluation system (Guskey, Sparks, 1991). 
Killion (2002) stated that for an evaluation system to be valuable it needs to study the impact of development of 
profession on instructional practices of educationalists and the effects on student learning(Killion, 2002). 
Furthermore, the evaluation system should be ongoing and sustained. 


3. Aims of the Study 

The study within hand aims at evaluating the impact of a long-standing diploma programs in academic departments 
in Majmaah University on a variety of measures of program competence. This study identifies factors needed to 
promote the successful implementation of diploma programs in the Majmaah University. For this research a case 
study type data has been collected at 8 different academic diploma programs in the University. It tries to answer 
some questions on the evaluation of diploma programs. The questionnaire protocol used in this study includes 
hypothesizes about aspects of diploma programs organization and organizational capacity, barriers and resources, 
and program outcomes for students, staff, and the local community. The study also evaluates some practices related 
to staff selection, methods of teaching evaluation, students' evaluation methods, staff evaluation, program evaluation, 
and administrative supports. These practices were instrumental in moderating contextual factors that might have 
hindered program implementation. 


4. Methodology 

In this research, the following methodology is chosen: 

4.1 Population of the Study 

The recent study explores the responses and opinions of 110 student (males and females) and 31 staff members 
(males and females). The staff members are from different ranks: professors (22), associate professors(9) and 
assistant professors(l 16). Ages of respondents have been categorized into the following: 

• Less than 25 years 

• From 26 to 35 

• From 36 to 45 

• More than 46 years old. 

These diploma programs are in 8 different academic disciplines. These disciplines are: Attorney and Law, Specific 
Education, Networks and Technology, Accounting, Education, Measurement & Evaluation and Guidance & 
Counseling. 

4.2 Stakeholders 

The recent study is conducted by using the descriptive method which is based on collecting, analyzing and 
organizing data quantitatively and qualitatively on the phenomenon subject to study in order to draw insightful 
conclusions and findings that provide us with better understanding and perception of it(Obeidat et al 2007). The 
following stakeholders were selected for the study: 
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Table 1. Stakeholders with Examples 

Stakeholder 

Examples of the vested interest of each stakeholder 

Teachers 

Professional satisfaction. 

Keeping a job. 

Students 

Learning something perceived to have value. 

Getting qualifications that can lead to employment. 

Subject and course coordinators 

Ensuring that the students' learning meets some quality assurance standards. 

Faculty deans 

Capacity to provide for increasing numbers of students. 

Meeting professional standards of the discipline area. 

Members of the university's 
chancellery 

Links to the university's strategic mission. 

Cost-effectiveness, especially in the provision of technology. 

Funding body 

Assuring that the product is congruent with the grant application. 

Employers 

A focus on graduate capabilities rather than all the intervening experiences. 

Professional accrediting bodies 

Standards relating to what skills and knowledge graduates require in particular 
professions for the 21st century. 


4.3 Method 

Students and members of staff are the principle components of the education system and surveys of their opinions 
are one of the most important sources of evidence about quality in higher education. They can provide very useful 
suggestions for improvement that should be considered in the quality cycle for improvement as applied to individual 
courses, programs, and institutional planning. Yin (1994) suggested the most appropriate methodology for explaining 
program implementation is case study. Thus, data for the larger study were collected using an in-depth case study 
approach. Using methods suggested by Mills and Ragan (2000), data collected over the course of an academic year 
included a systematic survey that identify of the core components of the diploma program. These components served 
as the basis for the data collection protocol that was followed throughout this process (Weiss, 1998). Hence, for this 
study case study method has been choosen. Data was collected over the course of an academic year included a 
systematic survey questionnaire of the students and members of staff in Majmaah University and a survey of the 
diploma program itself. 

4.4 Tool of the Study 

The recent study made use of the questionnaire as the major tool for collecting data and information about the 
population of the study. The questionnaire was designed after formulating the theoretical frame of the study and 
revising past literature on the topic. The data from this investigation led to the identification of the core components 
of the diploma program. These components served as the basis for the data collection protocol that was followed 
throughout this process. Data consisted of a total of 35 structured hypothesis questionnaires investigating the 
different aspects of 8 diploma programs. These diploma programs are in different disciplines like: Attorney and Law, 
Specific Education, Networks and Technology, Accounting, Education, Measurement and Evaluation and Guidance 
and Counseling. The study is conducted within the Riyadh campus of Majmaah University. 

The questionnaire measures the effectiveness of the diploma programs, it is divided into 6 main sections each of the 
first five sections tackles 5 hypothesizes for which the population of the study will respond with only one option out 
of four options ranging from complete agreement to absolute refusal. These options are: 

• Strongly agree 

• Agree 

• Don't agree 

• Strongly don't agree. 
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Likewise; the last section of the questionnaire includes 10 hypothesizes for which the respondents to the 
questionnaire will strongly agree, agree, strongly disagree or disagree. 

In this paper the questionnaire discusses the extent to which the diploma programs satisfy the needs of students. It 
covers the following 5 hypothesizes: 

1- The Diploma programs satisfy the scientific interests of students. 

2- The topics included in the diploma programs are compatible with student's specialization. 

3- The curricula delivered satisfy the student’s inclinations. 

4- The diploma program satisfies the scientific ambition of students. 

5- The diploma programs help improve the students' ability to analyze. 

5. Reliability 

To check the reliability, Cronbach’s alpha has been run and it shows the following. 


Reliability Statistics 


Cronbach's Alpha 

N of Items 

.766 

5 


Results shows that Cronbach's alpha value is high (0.766) which gives clear indication that there is internal consistency 
among the given items. 

6. Factor Analysis 

Factor Analysis is a data reduction technique. It also helps in structure detection among the variables and further helps 
in studying the underlying crucial factors that cause the maximum variation. Before we proceed for factor analysis first 
the researcher tested the eligibility of the data by checking KMO- Bartlett's test which is a measure of sampling 
adequacy. The KMO value is 0.881 >0.5 

Table 2. Factor Analysis 

KMO and Bartlett's Test 


Kaiser-Meyer-Olkin Measure of Sampling Adequacy. .881 

Approx. Chi-Square 1621.460 

Bartlett's Test of Sphericity Df 300 

Sig. .000 


Bartlett's Test of Sphericity indicates a measure of the multivariate normality of set of variables (Significant value is 
below 0.05 which indicates that multivariate is normal and is therefore acceptable for factor analysis 


S.NO 

Factor Name 

Factor loading value 

1 

Courses meet the student’s desire 

0.787 


Programs provide opportunities for students to meet the scientific interests 

0.777 

2 

Modern techniques facilitate accommodate students to the topics 

0.758 


Teachers benefit from the computer to provide references for teaching their 

courses 

0.712 

3 

Teachers give the research work high portion of the marks. 

0.706 

4 

Diploma programs provide the local community with qualified Saudis in 
various disciplines 

0.598 

5 

Teachers use the overhead projector in their teaching 

0.792 


Published by Sciedu Press 


85 


ISSN 1925-0746 E-ISSN1925-0754 




www.sciedu.ca/wje 


World Journal of Education 


Vol. 4, No. 4; 2014 


7. Hypothesis Testing 

1- To what extent the diploma programs meet the needs of students 


HO: There is no significant association between designation and their opinions on diploma programs meet the needs 

of students. 






Table 3. Statistical Results of First Hypothesis 







Crosstab 





1- To what extent the diploma programs meet the needs of students 

Total 


Strongly disagree 

Disagree 

Agree 

Strongly Agree 


Count 

2 

19 

59 

29 

109 

Student % within 

JOB J° B 

Count 

1.8% 

17.4% 

54.1% 

26.6% 

100.0% 

0 

5 

17 

8 

30 

Teacher % within 

JOB 

0.0% 

16.7% 

56.7% 

26.7% 

100.0% 

Count 

2 

24 

76 

37 

139 

Total % within 

JOB 

1.4% 

17.3% 

54.7% 

26.6% 

100.0% 

Chi-Square Tests 



Value 

df 

Asymp. Sig. (2-sided) 

Pearson Chi-Square 


.586 a 


3 

.900 

Likelihood Ratio 


1.008 


3 

.799 

Linear-by-Linear Association 


.096 


1 

.757 

N of Valid Cases 


139 





a. 2 cells (25.0%) have expected count less than 5. The minimum expected count is .43. 

From the table 3, chi square is not significant (sig. value is greater than 0.05), no evidence to reject null hypothesis. It 
means that there is no significant association between designation and their opinions on diploma programs meet the 
needs of students. 

2- To what extent the diploma programs meet the needs of community 

HO: There is no significant association between designation and their opinions on diploma programs meet the needs 
of community. 

Table 4. Statistical Results of Second Hypothesis 


Crosstab 





2- To what extent the diploma programs meet the needs of community 

Total 




Strongly disagree 

Disagree 

Agree 

Strongly Agree 




Count 

1 

18 

63 

28 

110 


Student 

% within 

JOB 

Count 

0.9% 

16.4% 

57.3% 

25.5% 

100.0% 

JOB 


0 

4 

14 

12 

30 


Teacher 

% within 
JOB 

0.0% 

13.3% 

46.7% 

40.0% 

100.0% 



Count 

1 

22 

77 

40 

140 

Total 


% within 
JOB 

0.7% 

15.7% 

55.0% 

28.6% 

100.0% 
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Chi-Square Tests 


Value 

df 

Asymp. Sig. (2-sided) 

Pearson Chi-Square 

2.638 a 

3 

.451 

Likelihood Ratio 

2.734 

3 

.435 

Linear-by-Linear Association 

1.920 

1 

.166 

N of Valid Cases 

140 




a. 3 cells (37.5%) have expected count less than 5. The minimum expected count is .21. 

From the table 4, chi square is not significant (sig. value is greater than 0.05), no evidence to reject null hypothesis. It 
means that there is no significant association between designation and their opinions on diploma programs meet the 
needs of community. 

3-The efficiency of teaching and learning methods in diploma programs 

HO: There is no significant association between designation and their opinions on efficiency of teaching and learning 
methods in diploma program. 

Table 5. Statistical Results of Third Hypothesis 

Crosstab 

3-The efficiency of teaching and learning methods in diploma Total 
programs 


Strongly 

Disagree 

Agree 

Strongly Agree 

disagree 





Count 

2 

43 

62 

3 

110 

Student % within 

JOB 

JOB 

Count 

1.8% 

39.1% 

56.4% 

2.7% 

100.0% 

1 

6 

22 

2 

31 

Teacher «/ 0 within 

JOB 

3.2% 

19.4% 

71.0% 

6.5% 

100.0% 

Count 

3 

49 

84 

5 

141 

Total % within 

JOB 

2.1% 

34.8% 

59.6% 

3.5% 

100.0% 

Chi-Square Tests 



Value 

df 

Asymp. Sig. (2-sided) 

Pearson Chi-Square 


4.748 a 

3 

.191 


Likelihood Ratio 


4.947 

3 

.176 


Linear-by-Linear Association 


2.990 

1 

.084 


N of Valid Cases 


141 





a. 4 cells (50.0%) have expected count less than 5. The minimum expected count is .66. 

From the table 5 chi square is not significant (sig. value is greater than 0.05), no evidence to reject null hypothesis. It 
means that there is no significant association between designation and their opinions on efficiency of teaching and 
learning methods in diploma program. 

4- Using of modern technologies in the diploma programs 

HO: There is no significant association between designation and their opinions on using modern technologies in the 
diploma programs. 
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Table 6. Statistical Results of Fourth Flypothesis 

_ Crosstab _ 

4- Using of modem technologies in the diploma programs Total 


Strongly Disagree Agree Strongly Agree 

disagree _ 



Student 

Count 

3 

24 

74 

8 

109 

JOB 

% within JOB 

2.8% 

22.0% 

67.9% 

7.3% 

100.0% 

Teacher 

Count 

1 

5 

22 

3 

31 



% within JOB 

3.2% 

16.1% 

71.0% 

9.7% 

100.0% 

Total 


Count 

4 

29 

96 

11 

140 


% within JOB 

2.9% 

20.7% 

68.6% 

7.9% 

100.0% 


Chi-Square Tests 



Value 

df 

Asymp. Sig. (2-sided) 

Pearson Chi-Square 

.624 a 

3 

.891 

Likelihood Ratio 

.640 

3 

.887 

Linear-by-Linear Association 

.347 

1 

.556 

N of Valid Cases 

140 




a. 3 cells (37.5%) have expected count less than 5. The minimum expected count is .89. 

From the table 6, chi square is not significant (sig. value is greater than 0.05), no evidence to reject null hypothesis. It 
means that there is no significant association between designation and their opinions on using modern technologies 
in the diploma programs. 

5- The efficiency of the methods used to assess students in diploma programs 

HO: There is no significant association between designation and their opinions on efficiency of the methods used to 
assess students in diploma program. 

Table 7. Statistical Results of Fifth Hypothesis 

Crosstab 


5- The efficiency of the methods used to assess students in diploma Total 
_ programs _ 




Strongly disagree 

Disagree 

Agree 

Strongly Agree 



Count 

2 

22 

66 

20 

110 

Student 

JOB 

% within 

JOB 

1.8% 

20.0% 

60.0% 

18.2% 

100.0% 

Count 

0 

2 

25 

4 

31 

Teacher 

% within 

JOB 

0.0% 

6.5% 

80.6% 

12.9% 

100.0% 


Count 

2 

24 

91 

24 

141 

Total 

% within 

JOB 

1.4% 

17.0% 

64.5% 

17.0% 

100.0% 

Chi-Square Tests 




Value 

df 

Asymp. Sig. (2-sided) 

Pearson Chi-Square 


5.165 a 

3 

.160 


Likelihood Ratio 



6.144 

3 

.105 


Linear-by-Linear Association 


.859 

1 

.354 


N of Valid Cases 


141 





a. 2 cells (25.0%) have expected count less than 5. The minimum expected count is .44. 
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From the table 7, chi square is not significant (sig. value is greater than 0.05), no evidence to reject null hypothesis. It 
means that there is no significant association between designation and their opinions on efficiency of the methods 
used to assess students in diploma program. 

Table 8. Summary of Hypothesis Testing 

NULL HYPOTHESES 

Sig. value 

RESULT 

HO: There is no significant association between designation and their opinions on 
diploma programs meet the needs of students 

0.900 

Accepted 

HO: There is no significant association between designation and their opinions on 
diploma programs meet the needs of community 

0.451 

Accepted 

HO: There is no significant association between designation and their opinions on 
efficiency of teaching and learning methods in diploma program 

0.191 

Accepted 

HO: There is no significant association between designation and their opinions on 
using modern technologies in the diploma programs 

0.891 

Accepted 

HO: There is no significant association between designation and their opinions on 
efficiency of the methods used to assess students in diploma program 

0.160 

Accepted 


7. Findings of the Study 

1- JOB * 1- To what extent the diploma programs meet the needs of students 

HO: There is no significant association between designation and their opinions on diploma programs meet the needs 
of students 

2- JOB * 2- To what extent the diploma programs meet the needs of community 

HO: There is no significant association between designation and their opinions on diploma programs meet the needs 
of community 

3- JOB * 3-The efficiency of teaching and learning methods in diploma programs 

HO: There is no significant association between designation and their opinions on efficiency of teaching and learning 
methods in diploma program 

4- JOB * 4- Using of modern technologies in the diploma programs 

HO: There is no significant association between designation and their opinions on using modern technologies in the 
diploma programs 

5- JOB * 5- The efficiency of the methods used to assess students in diploma programs 

HO: There is no significant association between designation and their opinions on efficiency of the methods used to 
assess students in diploma program 


8. Conclusion 

The study shows that from the correlation matrix diploma programs meet the needs of students is positively 
significant correlated with diploma programs meet the needs of community. The efficiency of teaching and learning 
methods in diploma programs, using of modern technologies in the diploma programs and efficiency of the methods 
used to assess students in diploma programs. Further it is highly positively correlate with diploma programs meet the 
needs of community 

The diploma programs meet the needs of community is moderately positively correlated with efficiency of the 
methods used to assess students in diploma programs. Using of modern technologies in the diploma program is 
moderately correlated with diploma programs meet the needs of students. 

Diploma program effectiveness in this university reflects the overall development of this program in different 
universities. This university was selected to find out the perception of stakeholders towards these programs so that 
higher education can take its policies accordingly. As in Saudi Arabia, more and more universities are now launching 
different diploma programs so that to develop the technical as well as mechanical skills among the students of these 
universities. Even these programs are now launched on evening hours as well as in summer vacation holidays, for 
which universities in Saudi Arabia provide necessary facilities for both students as well as to the staff. It is expected 


Published by Sciedu Press 


89 


ISSN 1925-0746 E-ISSN1925-0754 




www.sciedu.ca/wje 


World Journal of Education 


Vol. 4, No. 4; 2014 


that in future these course might have lot of scope because of their effectiveness in this country and because of the 
job market available for them. 
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